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ABSTRACT 



A linear programming model of U.S. Army Combat Develop- 
ment Experimentation Command is proposed. It provides a 
planning tool which allows utility, expressed as relative 
worth, to be maximized subject to resource constraints. 
Relative value of an experiment is defined to be the con- 
tribution which the experiment makes toward USACDEC's general 
experimental objectives. It is derived by determining all 
the tasks required to accomplish the command's general 
experimental objectives, evaluating the importance of each 
task in the accomplishment of the objectives, and determining 
how many of the tasks are accomplished by an experiment. 

This procedure leads to a number which represents the 
decision makers feelings about the importance of the experi- 
ment. The numbers are used as coefficients of a linear ob- 
jective function which is maximized by a zero-one integer 
program. The result is the selection from a set of ex- 
periments those which maximize relative value subject to 
resource constraints. 
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I. 



INTRODUCTION 



A manager must allocate available scarce resources to 
his subordinate activities in such a way that the output of 
the organization is maximized. He may be able to allocate 
the resources so that the output of a single subordinate 
activity is maximized but will usually find that the allo- 
cation is not best for the organization as a whole. His 
decision is, then, how to allocate available resources so 
that the organization as a whole will benefit most. 

Maximizing output subject to resource constraints has 
been the subject of much research and exposition. An ap- 
proach to the problem, developed by Dantzig^ for the U.S. 

Air Force, is the technique of linear programming. Variations 
of this approach have been used to develop models to help in 
the problem of capital budgeting. These models seek to 
choose from alternative investment possibilities the best 

combination possible within a given budget constraint. 

2 

Hillier proposes a model for selection of optimal in- 
vestment proposals from a set of proposals by maximizing 



1. Dantzig, G.B., Linear Programming and Extensions , 

Princeton, N.J.: Princeton University Press, 1963. 

2. Hillier, Frederick S.," A Basic approach to the Evalua- 
tion of Risky Interrelated Investments," in R.F. Byrne, et: 
al . , Studies in Budgeting , New York, N.Y.: American Elsevier 
Publishing Company, Inc., 1971. 
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expected utility. Both linear programming and a branch- 

and-bound algorithm are offered as solution techniques. 

3 

Naslund uses chance constrained programming (a linear 

programming technique with probabilistic constraints) to 

4 

solve the capital budgeting problem and Byrne uses a similar 
technique called two-staged linear programming under 
uncertainty. 

5 

Hartman and Moglewer use an approach based upon the 
theory of games to develop a model for allocating resources 
to research projects. 

The purpose of this paper is to address the problem of 
allocating scarce resources for experimentation in support 
of Army Combat Development. In particular, a model will be 
offered by which resources may be efficiently allocated to 
carry out general experimental objectives. The organization 
and functions of the U.S. Army Combat Development Experimen- 
tation Command (CDEC) will be presented as a framework for 
development of the model. The underlying assumptions and 



3. Naslund, Bertil, "A model of Capital budgeting Under Risk," 
in R.F. Byrne, et al . , Studies in Budgeting , New York, N.Y.: 
American Elsevier Publishing Company, Inc., 1971. 

4. Byrne, R. F. , "A Chance Constrained Approach to Capital 
Budgeting with Portfolio Type Payback and Liquidity Constraints 
and Horizon Posture Controls," in R.F. Byrne, et cLL., Studies 
in Budgeting , New York, N.Y.: American Elsevier Publishing 
Company, Inc., 1971. 

5. Hartman, Frederick and S. Moglewer. "Allocation of Re- 
source to Research Proposals," Management Science , 14:1 
(September, 1967) 
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ideas of the model will be discussed in detail and a hy- 
pothetical problem and its solution presented. 

Two definitions are necessary at this point. The first 
is combat development which is 

...the formulation of new or improved army doctrine, 
organizations, and material objectives and tjge early 
integration of these products into the Army. 

The other is field experimentation which is 

...a series of field trials, under controlled con- 
ditions, employing appropriately trained personnel and 
selected types of equipment in functionally designed 
operational mixes, the actions and interactions of 
which are objectively instrumented, measured, and re- 
corded for scientific analysis. 

Combat development is concerned with new ideas and con- 
cepts which may exist only as mathematical formulas or models. 
At a lower level of abstraction is field experimentation, 
used to test hardware in order to derive numbers which can 
be used in combat simulations and war games. 

A. CDEC : EXTERNAL 

Figure 1 gives the position of CDEC within the Department 
of Army /Combat Development Command hierarchy. CDC directs 
Army combat development activities under the general guidance 
of the Department of Army and is the major Army command re- 
sponsible for combat development. 

B. CDEC : INTERNAL 

Figure 2 gives the organization of CDEC. There are seven 
important subelements within the organization, and all combine 



6. Experimentation Manual, USACDCEC, July 1971. pp. 1-1, 
!-2 . 



7. Ibid . p. 2-1. 
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Figure 



efforts to accomplish CDEC's mission of field experimentation. 
Keyed to Figure 2, they are, in order, (and greatly simpli- 
fied) : 

1 . Scientific Support Laboratory ; 

civilian contractor; provides CDEC with technical 
advice in experimental design and engineer support. 

2 . DCS, Administration and Logistics : 

performs usual administration and logistic function. 

3 . DCS, Plans and Programs : 

responsible for long range experimentation; planning 
initial contact on all proposed experiments; all actions 
through completion of Project Analysis. 

4 . DCS, Experimentation ; 

responsible for planning, execution, and reporting 
of experiments after Project Analysis; determines total 
experimentation requirements. 

5 . DCS, Instrumentation : 

provides instrumentation support to field experimen- • 

tation . 

6 . DCS, Comptroller : 

performs the usual budgetary function. 

7 . Experimentation Brigade ; 

provides command and control for player and other 
support personnel. 

The interaction of these elements may be depicted 
graphically as in Figure 3 and Figure 4, which trace through 
the organization a CDC concept which is to be tested. These 
charts also describe the experimental cycle which consists 
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Figure 



of the steps necessary to plan, conduct, and report a field 
experiment. The primary concern here will be with the initial 
planning, in particular the Project Analysis. 

Action after the Project Analysis consists of detailed 
planning, execution, and reporting the experiment. The fact 
that these actions are not discussed further here does not 
mean that they are not considered to be important. To the 
contrary, they are the essence of the operation. Experimen- 
tation can proceed without a well defined plan, but not with- 
out good execution. An experiment which is well planned and 
well executed will provide a much better end result. It is 
the aim of this paper to aid in this planning. 

C. PROJECT ANALYSIS 

The purpose of the project analysis is to develop a 
concept for experimentation which will best satisfy ex- 
perimental objectives within available resource and time 
constraints. Within this concept, a design must be developed 
that will accomplish experimental objectives. 

A project analysis may generally be described as follows: 
experimental objectives contained in the CDC Experimentation 
Schedule (or from other sources) are analyzed to determine 
specific tasks. These general objectives are then defined 
in terms of actions which must be taken and measurements 
which must be made. The analysis is done by a project 
analysis task group which has in it representatives from the 
seven subelements of CDEC. The project group specifically 
considers such things as constraints on location, resources, 
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Figure 4 
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and time, scenario, data requirements, instrumentation re- 
quirements, scheduling, budget estimates, and experimental 
design. Particularily interesting is the requirement for 
the scheduling of resources by the Project Analysis Group. 
This can become an extremely difficult task in which a pro- 
posed experiment (or set of experiments) must be scheduled 
concurrently with other experiments, all of which compete 
for the same scarce resources.^ 

D. ALLOCATION PROBLEM 

Stated simply and briefly, CDEC ' s allocation problem is 
that there are normally not enough men and equipment to do 
all the experiments that CDEC wants to do. Since there is 
not enough to go around, how should that which is available 
be allocated? Should scarce resources be equally divided 
among all competing experiments or should more be given to 
the more important experiments? In what sense is one ex- 
periment more important than another? After an allocation 
has been proposed how can one be sure that it is the best? 
Subsequent sections will attempt to provide an approach to 
answering these questions. 



8. The preceeding discussion was based on information 
contained in Experimentation Manual , USACDCEC , July 1971 
and USACDCEC Organization and Functions Manual , May 1970. 



14 



II. RELATIVE VALUE 



This section will attempt to provide an answer to the 
question: In what sense can one experiment be more important 
than another experiment? To answer the question, the concept 
of relative value (of an experiment) will be introduced, 
defined, and described in detail. A method by which the 
relative value of an experiment can be derived will be 
proposed. This method will allow the relative value of an 
experiment to be expressed by a single number, providing 
a means of comparing the importance of two different ex- 
periments. Relative value will be defined in terms of general 
experimental objectives and objective components. Quantifi- 
cation of relative value will be done by an approach called 
detailed component analysis. 

The general idea for an approach using the concept of 
relative value came from an article in Operations Research 
by Chamberlain and Kingsland^ which presented a method for 
measuring the contributions of proposed unmanned missions 
toward attaining the scientific objectives of exploring 
the solar system. Major objectives are first identified, 
e . g. , "Investigate the origin and evolution of life in the 
solar system; investigate the origin and evolution of the 



1. Chamberlain, Robert G. and Louis Kingsland, Jr., "A 
Methodology to Compare Policies For Exploring the Solar 
System," Operations Research , 18:4 (July-August, 1970). 
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2 

solar system. " These major objectives are then defined in 

greater detail by a set of sub-objectives. An "objective 

tree" is constructed representing successive levels of detail 

until specific accomplishments (tasks) are identified. This 

3 

process is depicted in Figure 5 . 

The numbers above the sub-objectives in Figure 5 are 
determined by considering the relative contribution of each 
of the branches (sub-objectives) to the next higher branch. 
Major objectives are not assigned a value, so a value rela- 
tive to all the major objectives cannot be computed. It 
is assumed here that the major objectives cannot be compared. 

In order to compute the contribution of a proposed mission 
to a particular major objective, the tasks on the tips of the 
objective tree which will be accomplished by the mission are 
listed. For example, a mission which only searched for 
actual extraterrestrial life on Mars and Venus would accomplish 
two of the tasks at the tips of the tree. They are considered 
to be worth .20 and .70 respectively, to the accomplishment 
of the next higher branch. Together they accomplish .90 
of the next higher branch. The next higher branch is weighted 
.70 and since it is only .90 accomplished the .70 it is 
weighted is multplied by .90. No other subtasks contribute 
so the contribution of this mission to the major goal is 
.63 ( . 90x. 70) . 



2. Ibid , p. 602. 

3. Ibid , p. 597. 
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This general approach, with certain modifications and 
extensions, will be used to evaluate experiments. The ap- 
proach will be modified so that major objectives will be 
compared and will be extended to consider experiments of 
the type performed by CDEC. 

The preceeding description hints at the idea of relative 

\ 

value to be used in this paper. Fishburn says that it is 

"...assumed meaningful to consider a set of real numbers ... 

to describe the relative importance of the consequences to 

4 

the decision maker," . 

He admits that it is theoretically possible to measure 

this number but indicates that there are great practical 

difficulties caused by the requirement to measure and use 

subjective probabilities. These difficulties are caused by 

the large number of consequences which the decision maker 

must consider and by his ability to state his preferences 

honestly and without ambiguity. Other problems are the fact 

that objectives may be uncertain and preferences may change 

over time. The undesirable consequence of such an assumption 

is that an individual's stated preference may not accurately 

5 

reflect his true feelings. 

Although he assumes that it is possible for relative value 
to exist, he declares that any attempt to measure a unique 



4. Fishburn, Peter C. Decision and Value Theory , New York: 
John Wiley & Sons, Inc., 1964, p. 123. 

5. Ibid , pp. 84-87. 



18 



number is at best approximate. The important idea is the 
ability to represent importance to the decision maker by a 
number and the fact that that number will probably be only 
approximate. Fishburn is also strongly against the idea that 
the magnitude of importance can be represented by the magnitude 
of a number and that a consequence or event with a number 
.80 assigned to it is twice as important as a consequence 
with .40 assigned to it. The ability of a decision maker to 
do this is questionable and schemes using subjective prob- 
abilities have been devised to get around the problem. Other 

authors feel, however, that the test of a concept should be 

7 8 

whether or not it produces results. Pardee and Miller 
have approached the concept in this fashion and this paper 
will approach it in the same manner. 

Miller formulated a procedure for assessing worth and 
designed an experiment to test whether or not professional 
decision makers could implement the procedure and with what 
degree of success. The experiment was performed on students 
at the Defense Weapons System Management Center at Wright- 
Patterson Air Force Base, Dayton, Ohio. It involved a set 
of decisions the students made while at the school and it 
indicated that the worth assessment procedure can be used to 



6. Ibid, p. 123. 



7. Pardee, F.S., et al. , Measurement and Evaluation of 
Transportation System Effectiveness , Santa Monica: The Rand 
Corporation, 1969. 

8. Miller, James R. III. Professional Decision Making , 

New York: Praeger Publishers, 1970. 
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assess alternatives and can be used to make decisions as long 
as the process reflects what the decision maker wants it to 
reflect . ^ 

The method that will be followed closely here is developed 
by Parde, et a_l. It recognizes the problems pointed out by 
Fishburn, but trys to develop a model that, if understood and 
properly used, will yield results. 

A. RELATIVE VALUE OF AN EXPERIMENT: 

The relative value of an experiment will be defined in 
terms of experimental objectives and objective components. 
These two ideas are defined as: 

1 . Experimental Objectives : 

The goals toward which an experiment or set of ex- 
periments are conducted. These are assumed to be known to 
CDEC decision makers and planners and may be long range or 
confined to a particular time period. They may be such ' 

goals as finding information about new equipment or concepts 
and may be internally generated or directed by CDC. 

2 . Objective Components : 

The sub-objectives and specific tasks which if ac- 
complished will complete all of the experimental objectives. 

It is assumed that at any point in time a set of 
experimental objectives and objective components exists and 
is known to the planners and decision makers of CDEC. That 



9 . Ibid . , p. 195 . 



is, they know what must be done and all the tasks required 
to do it. The relative value of an experiment is it's contri- 
bution toward accomplishing the experimental objectives. 

B. METHODOLOGY: GENERAL: 

A number must be assigned to each experiment to represent 
its relative value. Pardee assigns value to transportation 
systems by assigning something called worth to the lowest 
level of his objective tree. These values are then carried 
up through the tree to give a value for the proposal. Here, 
the lowest tasks receive value of 0 or 1 depending on whether 
or not a proposed experiment accomplishes a task. If the 
task is accomplished it is assigned a value of 1.0; if not, 
it is assigned a value of 0.0. Before a number for the 
relative value of the experiment can be arrived at, the 
relation of all the experimental components must be stated. 
This is the process described earlier in which the contribu- 
tion of each sub-branch of a branch is evaluated relative 
to the other sub-branches in that branch. Once these numbers 
are available, computing the relative value of an experiment 
is an easy task. 

C. DETAILED COMPONENT ANALYSIS: 

This is a process in which objective components are stated 
and contributions to higher objectives determined. Again it 
must be emphasized that it is assumed that experimental 
objectives can be decomposed by planners and decision makers 
until specific tasks are stated. These must be tasks which 
people who carry out experiments can understand and perform. 
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It is necessary to distinguish between the relative value 
of an experiment and the relative contribution of a component 
to a higher objective. The term weight will be used to 
describe the relative contribution of a component. The 
weights assigned to all the components resulting from the 
decomposition of experimental objectives will be used to 
determine the relative value of an experiment. 

1 . Assignment of Weights to Components ; 

The procedure for assigning weights follows the 
general idea expressed in the space exploration example 
and in particular -follows closely an algorithm given by 
Pardee. ^ This procedure, slightly modified to fit in the 
experimental framework is as follows: 

a. Define a set of weights for every component which 

% 

is subdivided. Each sub-division is assigned a number. 

b. The number assigned to each component sub- 
division is interpreted as the perceived relative importance 
of each sub-division in accomplishing the component of which 
it is a part. 

c. Relative importance will be reflected in the 
ratios of assigned weights. 

d. Weights will be in the range 0.0 to 1.0. 

e. Weights are assigned by pairwise comparison of 
sub-divisions . 



10. Pardee, op. cit . , pp. 420-422. 
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2 . Pairwise Comparison 



Sub-divisions are listed in order of importance and 
the number 1.0 assigned to the most important (first in the 
list). Next, the second sub-division is compared to the 
first. If accomplishment of the second sub-division seems 
only 1/2 as important as the first, then the number .50 is 
assigned to it. Then compare the second and third sub- 
division and assign a number to the third which reflects 
it's importance relative to the second, multiply this number 
by the number assigned to the second and assign the product 
to the third sub-division. For example, if the second sub- 
division were assessed as being 1/2 as important as the first 
and the third 1/5 as important as the second the number as- 
signed to the third would be 1/2 x 1/5= 1/10= .10. Repeat 
this procedure until the list is exhausted. Finally, sum 
all the assigned numbers and divide each assigned number by 
the sum. This will give a set of positive numbers which 
sums to 1.0 and preserves the ratios of any pair of weights. 

D. ILLUSTRATION 

The above process will now be illustrated by a hypothet- 
ical example. Assume that there are only two experimental 
objectives 0 i and 0 2 . Let 0 i be a requirement to gather data 
about the optimum size of the infantry squad and let O 2 
be a requirement to gather data about optimum ratio of 
observation helicopters to attack helicopters in the attack 
helicopter team. The decomposition of the experimental 
objectives is dipicted in Figure 6. 
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Figure 



First consider the relative importance of the two ob- 
jectives to the overall objective, i.e. accomplishing all 
experimental objectives. The planners may feel that the 
two are not equally important and will list them in order 
of importance, e.g., [Oi, 0 2 ]/ Oj being more important. The 
first step is to assign to 0 i a value of 1.0. Now consider 
O 2 . The planner feels that it is only 2/3 as important as 
Oi hence he assigns the number 2/3 to it. Next the assigned 
numbers are added giving 1.0 + 2/3 = 5/3. Each assigned 
number is divided by 5/3 giving It 5/3 = 3/5 = .60 and 
2/3t 5/3 = 2/5 = .40. Therefore Oi has a weight of .60 
and O 2 has a weight of .40. The remaining weight assignments 
have been computed and are shown in Figure 7 . The experimental 
objectives have been decomposed into components and weights 
have been assigned to them, completing the detailed component 
analysis . 



E. RELATIVE VALUE OF AN EXAMPLE EXPERIMENT 

The state of each of the lowest level components located 
at the tips of the "objective tree" can be described by a 

variable X. , where 

D 



1 if component j is to be performed 
0 if component j is not to be performed 



Assume that an experiment, consisting of some of the X. 

3 1 

is proposed. For example, an experiment Ei could be the set 
of components [ X 1 , X3] . This experiment would consist of 
gathering data about optimum size of infantry squads at 
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Figure 



night on trails and during the day on trials. All of the 
components Xi through Xio (and hence both experimental ob- 
jectives) would be accomplished by the following set of 
experiments : 

Ei = [Xi,X 3 ] E 2 = [X 2 , X 4 ] E 3 = [X 5, X 8 ] E 4 =[X 6 , X 9 ] E s = 

[X 9 , X i o ] 

Now it is possible to determine the relative value of 
each of the proposed experiments. For each experiment 
assign a number to all X^ associated with the objective tree; 
Xj = 1 if the experiment will accomplish component j , X ^ = 

0 if not. Multiply X^ times the weight of the component 
with which it is associated. Beginning with the lowest level, 
sum the products of component weight and X^ for components 
which are sub-divisions of the same branch. Next, multiply 
this sum times the weight of the next higher branch. This 
gives a new tree, reduced in detail by one level. Continue 
until one number is obtained. 

For example, consider E 2 and refer to Figure 7. Since 
Xi and X 3 are to be done by this experiment, Xi and X 3 are 
assigned the value 1.0 and X 2 , X 4 , X 5 , X 6 , X 7 , X 8 , X 9 , X i o are all 
assigned the value 0.0. Examine the "night" branch of 0i. 
Since X 2 is zero (it is not done in this experiment) it has 
no value. Xi is 1.0 however, and contributes value. The 
first step then, is to multiply .20 by 1.0 and .80 by 0.0. 

Add these two values to get .20. Next multiply .2 by .6 
(the weight of the next higher branch) to get .12. In the 
same manner in the "day" branch .40 x .40 = .16. Thus the 
"night" branch contributes .12 and the "day" branch .16 for 
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a total of .28. There is no contribution from 0 2 so the 
relative value of the experiment is .28 times the weight of 
Oi or .168. Evaluation of the remaining experiments gives 
relative values of 

Ci = .168 C 2 = .432 C 3 = .176 C h = .104 C 5 = .120 

These numbers indicate that experiment two (E 2 ) would 
yield the greatest contribution toward the overall experimental 
objectives. Experiment five gives the least contribution. 

If only one of the experiments can be carried out, then 
experiment two would be the logical choice, assuming that 
the costs of the experiments is not considered. 

This completes the discussion of relative value. It 
allows the value judgements of planners and decision makers 
to be stated explicitly. It is difficult to justify theo- 
retically, but if it reflects accurately the decision maker's 
assessment of the importance of experiments it can be a 
useful tool . 

If the preceeding is acceptable to the decision maker, 
he can now discriminate between different experiments and 
can get a feeling for how an experiment will contribute to 
his over all goals. Suppose, however, that the resources 
necessary to complete all the experiments are not available. 

If this is the case, then only some of the experiments can 
be done. If there is only one resource to be considered, 
then experiments are chosen in descending order of the ratio 
of the relative value to the amount of the resource required. 

If there is more than one resource involved the problem 
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becomes much more complicated and must be approached by some 
form of linear programming. 



29 



III. THE MODEL 



The purpose of this section is to introduce a linear 
programming model of CDEC. The assumptions of the model 
will be stated, the model described, and illustrated by a 
continuation of the hypothetical example of section II. It 
will be assumed that the reader has a knowledge of the 
techniques of linear programming. 



A. OBJECTIVE FUNCTION 

In the model, experiments are represented by the variable 
E j . The model assumes that the output of CDEC can be rep- 
resented as a linear function of the experiments to be 
performed, i ♦ e . , 

Z = C1E1 + C2E2 + • . • + CjEj 

The contributions of different experiments to the objective 
function are assumed to be independent of other experiments. 

Resources will be represented by b^ where b^ is the 
amount of the ith resource available. Resources are related 
to experiments by a^, the amount of the ith resource required 
for the jth experiment. Now the model can be stated (for 
two experiments and two resources) as 

Max Z = C1E1 + C2E2 
s.t. aiiEi + ai 2E2 
ai2Ei + a 22 E 2 

It is assumed that the amount of resource required by 
one experiment does not affect the amount required by another. 
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In this model Z will represent relative value as defined 



in the previous section. The coefficients will be the 
numbers derived to represent the contribution of each E ^ to 
accomplishment of all experimental objectives. Using the 
numbers from the previous example, the objective function 
for that five experiment case is 

Z = . 168E i + . 4 32E 2 + .176E 3 + .104E 4 + .120E 5 

For reasons which will be discussed later, let 

Z -= 1000Z = I 68 E 1 + 432E 2 + 176E 3 + 104E 4 + 120E S 



B. RESOURCE CONSTRAINTS 

For clarity of presentation, from this point on the model 
will be discussed in terms of the example in section II. As- 
sume that the five experiments only require three resources; 
i . e . , instrumentation, helicopters, and men, and let the 
amount of instrumentation available be bi; helicopters, 
b 2 ; and men, b 3 . The model is now 

Max Z = I68E1 + 432 E 2 + 176 E 3 + 104 E 4 + 120 E 5 

s.t. aijEj + a 1 2 E 2 + a 1 3 E 3 + ai 4 E 4 + ai 5E5 < b 1 

a 2 iE 1 + a 22 E 2 + a 2 3 E 3 + a 24 E 4 + a 2 5E5 < b 2 

a 3 1 E 1 + a 3 2E 2 + a 33 E 3 + a 34 E 4 + a 35 E 5 £ b 3 

To this point no restriction has been placed on E^ . It 
will be assumed that an experiment will either be completely 
done or not done at all. This allows E^ to have only zero 
or one for a value. 

The model will now be extended one step further by as- 
suming that resource availability is time dependent. This 
means that resource requirements and availabilities can vary 
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from time period to time period. For simplification four 

time periods are assumed. The model now is as shown in 

k k 

Figure 8. The superscript k on a^^ and indicates the 
time period. The model in Figure 8 is for two time periods, 
two experiments, and two resources. 

Resources for the example situation are shown in Figure 
9. Further information about specific experiments is in- 
cluded in this chart. Notice that not all experiments re- 
quire all four time periods. If, for example, an experiment 
requires only three time periods, it is possible to begin 
that experiment either in time period one or time period 
two. (It is assumed that experiments cannot be broken up, 
i . e . they must run on consecutive days.) This gives in 
effect two experiments, both of which must be considered 
when a maximum for Z is sought. For example, consider E 2 
which requires no resources for one period and some resources 
the other three. E 2 can start either in period one or period 
two. It cannot start any later than period two since a later 
starting time would not allow the experiment to be completed. 
E 2 must now be described by two variables, say Hi and H 2 , 
and since only one of this set is to be performed, the ad- 
ditional constraint that Hi + H 2 = 0 or 1 is added. This 
constraint says that either Hi or H 2 but not both can enter 
the linear program solution. This last constraint has the 
further advantage that it provides a schedule of the ex- 
periments which are selected. 
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RESOURCE AVAILABILITIES 
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C. ILLUSTRATION 

The complete model will now be illustrated by the example 
data provided in Figure 9. The five experiments have been 
extended to fourteen by the reasoning just described. The 
problem is dipicted in Figure 10. 

1 . Solution Procedure 

Solution of the example in Figure 10 is by an integer 
programming routine called ARRIBA. (See Appendix A) . The 
program is not zero-one but by specifying that each variable 
be less than or equal to one a zero-one program is obtained. 

A solution requires only that data consisting of the coef- 
ficients (Cj) of the objective function (Z) and the coef- 
ficient matrix of a^j and b^ be entered. Since the program 
is integer zero-one an objective function with fractional 
or decimal coefficients would give a trivial solution with 
all Ej equal zero. For this reason Z is transformed to get 
rid of the decimals in the original objective function. 

2 . Solution 

The solution of the example in Figure 10 is given in 
Figure 11. The detailed solution, shown in the computer 
output appendix, gave the following values for the fourteen 
variables: Hi = H 2 = H 5 — H 6 = H 7 — H g — Hg = Hi 1 — Hi 3 = 

Hi 4 = 0 and H 3 = H 4 = Hi 0 = Hi 2 = 1. None of the variables 
which make up experiment three (H 6 » H7) were assigned a 
value of one, so that experiment was not performed at all. 
Experiment four, with a smaller contribution (relative value) 
than experiment three, was, however, chosen. 
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Figure 10 
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3. Comment 



The model can be described as a zero-one linear 
programming model which has as an objective the maximization 
of relative value. Relative value is arrived at by considera- 
tion of experimental objectives and a detailed component 
analysis. Resource availabilities and requirements by time 
period are assumed to be known. The solution of the linear 
program is in the form of an experimental schedule and is 
arrived at by a prepackaged computer program. 

An answer has now been offered to the question of 
how resources should be allocated to competing experiments. 

A model has been described and given substance by an example. 
Now questions arise about the form of the model and some 
examination must be made of how sensitive it is to changes 
in its form, specifically, how will it react to changes in 
the' coefficients of the objective function and the b^ . 
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IV. SENSITIVITY ANALYSIS 



This section will examine the effect of changes in the 
amount of available resources and coefficients of the ob- 
jective function. The effect of relaxing the assumption 
that experiments must be performed in consecutive time 
periods will be considered as will a solution arrived at by 
relaxing the requirement that the experiment be performed 
or not performed (zero-one assumption) . 



A. CHANGES IN THE OBJECTIVE FUNCTION 

In the example problem Oi was valued at .60 and O 2 at 
.4. The value of the C ^ in the objective function depends 
upon the value of Oi and O 2 and the Cj change as they change. 

Oi was allowed to vary from .1 to .9 and O 2 varied accordingly. 
New values for Cj were computed for each of the nine values 
of Oi and O 2 . These values appear in Figure 12. The sched- 
ule corresponding to these values appear in Figure 13. For 
Oi = . 1 , O 2 = .9; Oi = .2, 0 2 = *8; 0 1 = .3/ O 2 = . 7 , the 
solution was schedule one in Figure 13. For the remainder 
the solution was schedule two in Figure 13. 

Varying the weights of the two experimental objectives 
gave a change in schedule. That change deleted experiment 
three from schedule one and added experiments one and four. 
Experiment two was unchanged, but experiment five was moved 
from period four to period one. 

The model was fairly insensitive to changes in the weight 
of Oi and O 2 since there was only one change of schedule as 
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these values varied over the range which they were allowed 
to assume. 

B. RELAXATION OF RESOURCE CONSTRAINTS 

Consider the effects of relaxing each binding resource 
constraint for a solution. The value of the objective 
function (z) can change as can the solution schedule. In 
a normal linear program the increase in the objective function 
as binding constraints are relaxed can be used to imput a 
value to resources. 

This concept cannot be used in integer programming. 
Consider again the solution to the example problem in which 
the value of the objective function for the solution is 824, 
and the binding constraint (slack is zero) is instrumentation 
in the third time period. When the number of men available 
in this period was changed from 110 to 300 the value of the 
objective function changed to 896 with the schedule shown 
in Figure 14. There were then three binding constraints, 
i . e . instrumentation in the fourth time period and men in 
both the third and fourth periods. (See Figure 15). When 
these three constraints were relaxed, the new value of Z was 
896 with the same schedule. Further, there were no binding 
constraints . 

When the first constraint was relaxed, the objective 
function increased from 824 to 896 for an increase of ten 
units of instrumentation. This increase would not have 
occured, however, for any increase smaller than ten. It 
took exactly ten units to get the increase, whereas in a 
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normal linear program some increase in Z would have been 
noted for an increase of one unit. In a normal linear 
program the imputed value of a unit of instrumentation would 
be 52/10 = 5.2. This implies that five units of instrument- 
ation would produce an increase of 26 in the objective 
function. This is clearly not the case for an integer 
program . 

C. NONCONSECUTIVE SCHEDULING 

It was previously assumed that experiments could not 
be broken up, i . e . that once begun they must be run until 
completed. An example similar to the initial example was 
solved under this assumption and then with the assumption 
relaxed. The example chosen has three experiments and three 
resources and uses the same C a , C z and C 3 of the initial 
example. The problems are stated in Figures 16 and 17. 

Note that the first problem (under the initial assumption) 
has seven variables whereas the second has fourteen. This 
need for more variables is a distinct disadvantage or 
relaxing the assumption. 

The advantage of relaxing the assumption is clear in 
the solution schedule in Figure 18 and in the value of the 
objective function. Under the assumption of consecutive 
scheduling only one experiment could be performed with a 
value for Z of 432. The other scheduling assumption al- 
lowed two experiments for a value of 600. 
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Figure 17 
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D. INTEGER PROGRAM 



If the five experiments in the example are considered 
to be iterations of an experiment rather than a complete 
experiment, then the zero-one requirement of the program 
can be disregarded. The same objective function can be 
used but it can take on values greater than 1000, since now 
experiments can be scheduled more than once. The are no 
longer relative value as it was earlier defined, but are 
viewed as an indication of the value of an iteration of an 
experiment. This procedure was applied to the initial 
example with all "less than or equal to one" constraints 
removed. The solution schedule is in Figure 19. It recom- 
mends that experiment one be done twice and that experiment 
five be done eight times, twice during each period. 

E . COMMENT 

It appeared that the model will provide different sched- 
ules for different values of the coefficients of the objective 
function allowing the planner and decision maker to reflect 
a change in his priorities. Changes in resource constraints 
also gave different schedules, but only for discrete jumps in 
the availability of resources. 
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V. CONCLUSIONS 



The model gives a planner or decision maker an approach 
to the problem of how to allocate resources so that ex- 
perimental objectives are best met. The measure of ef- 
fectiveness of resource allocation is the degree to which 
experimental objectives are met. A detailed analysis of 
how proposed experiments can be done and a subjective eval- 
uation of the relative importance of the components which 
comprise the total experimental plan is required to derive 
this measure of effectiveness. The measure of effectiveness 
is transformed into a linear relationship of experiments and 
this linear relationship is then maximized subject to resource 
constraints . 

Resource constraints are given by time period as are 
experimental requirements. The linear program is then 
solved by an integer zero-one linear program algorithm pro- 
viding a solution in the form of an experimental schedule. 

A. CAPABILITIES OF THE MODEL 
1 . Planning 

The model is a planning tool which can be used to 
predict gross over-commitments or under use of resource. 
Subjective feelings of planners about the importance of 
competing experiments are made explicit in the objective 
function, the coefficients of which can be readily varied 
as changes in priorities occur. Changes in the parameters 
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of the model (resource requirements and availabilities) can 
be made with little effort, allowing the planner to examine 
how changes in these parameters will effect the current 
schedule . 

2 . Resource Allocation 

The model establishes for the planner a link between 
the value of experiments and resources. The link may appear 
tenuous but can still give him an indication of the efficiency 
of his resource allocation. 

B . SHORTCOMINGS 

1 . Subjective Evaluation 

The model allows the planner to make explicit sub- 
jective evaluations, but he must remember that the fact that 
the evaluations are stated does not make them more objective. 
For this reason care must be taken when decisions are to be 
made and final decisions regarding schedules should be based 
on a firmer basis than is provided by the model. The sched- 
ule proposed by the model should be only one of the factors 
which the manager uses in arriving at a solution. 

2 . Uncertainty 

The model does not consider uncertainty because it 
is beyond the scope of this paper. It is clear that the 
future availability of resources and the future requirements 
for experiments are uncertain. A change in the structure of 
the experiment can change the requirements for that experiment 
and the reliability of equipment and availability of personnel 
can never be accurately predicted. It is assumed that the 
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planner will provide the model with the best information 
available and will update the model as new information be- 
comes available. 

3 . Assumptions 

As previously noted, the model assumes that the 
worth contributed to the relative value of a proposed set 
of experiments by each separate experiment is independent 
of the other experiments. This allows the separate worths 
to be added. If this assumption is not true and hence the 
objective function and/or the constraints are not linear, 
a grossly inefficient allocation may be proposed by the 
model . 

C. FURTHER STUDY 

1 . Uncertainty 

As was indicated earlier uncertainty in linear pro- 
gramming has been approached by the techniques of linear 
programming under uncertainty and chance constrained linear 
programming. Uncertainty could be introduced into this model 
by either of these techniques or by a PERT-type technique 
which would assume some beta distribution for resources. 

Past experience could be used to derive means and variances 
of available resources and the information projected into 
the future. 

2 . Other Solution Procedures 

Network algorithms which offer a more exact solution 
to the integer linear program are available. An alternate 
solution procedure could possibly be based on such a technique. 
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3. Validation 



The model should be applied to an actual resource 
allocation problem in an organization such as CDEC and the 
resulting schedules compared with schedules arrived at by 
normal procedure. This would require on the part of the 
planners involved an understanding of the concept of relative 
value . 

4 . Worth of an Experiment 

It may be possible to apply the idea of relative 
value to a single experiment by considering different forms 
of the same experiment and examining how they contribute to 
the objective of the experiment in question. An indication 
of the value of a proposed change in the form of an experiment 
would be the change in the relative value of that experiment 
caused by the change in form. 

D. A PROPOSAL 

It is proposed that the model be considered for use in 
the planning of CDEC's experimentation. The model as de- 
scribed is greatly simplified but can be adapted for use at 
CDEC by increasing the number of resources and time periods 
to a useful level. Specifically, the model can be used in 
the Project Analysis stage of experimentation planning. 

Recall that the purpose of a Project Analysis was to 
develop a concept for experimentation that would best satisfy 
experimental objectives within available resources and time 
constraints. The first task of the Project Analysis group 
was to analyze experimental objectives to determine specific 
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tasks. This is also the first step required in the model; 
the detailed component analysis. The Project Analysis Group 
next considered the resources available and the experimental 
requirements. Finally the group proposed a schedule for 
the experiment under consideration. The model is designed to 
aid in all these tasks. Its use can provide a better under- 
standing of the structure of experiments and can aid in the 
efficient allocation of resources to experiments. 
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APPENDIX A 



PRELIMINARY 

USER INFORMATION MANUAL 
ARRIBA 

AN ALL- INTEGER 
PROGRAMMING SYSTEM 



February 25, 1969 



Written by: 

R.E. Woolsey, Candia Corp. and University 
of Texas 

Brady Holcolm, Union Carbide 
Peter Ryan, Stanford University 
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ARRIBA USERS MANUAL 



The ARRIBA system facilitates the solution of small integer 
programming problems by a variety of solution algorithms. 

Input is standard "SHARE'.' The system is written in a basic 
FORTRAN to facilitate conversion to various machines. The 
system is open ended in the sense that new solution algorithms 
are relatively easy to add. 



1. CONTROLS, CARD: 



The first card in any problem deck must be a CONTROLS, 
card. If it is not found, the program will test for an EXIT 
card. If an EXIT card is not found, the problem is terminated 
with ISTAT = 18, and the program searches forward until anoth- 
er CONTROLS card is encountered. The format of the card is 
seen below, CC. 1-80. CONTROLS, LIST = A, OBJ VALUE EVERY A AAA, 
ACTIVITY LIST EVERYAAAAA , PIVOT LIMITAAAAA AAA 



Options: A. LIST = 1, prints input data on the standard 

output. 

LIST = 0, suppress printing of input data 
(cc . 15 ) . 



B. OBJ VALUE EVERY , gives value of 

objective function every xxxxth iteration 
(CC. 31-34). 

C. ACTIVITY LIST EVERY , gives values of 

all variables every xxxxx iteration (CC. 56-69). 

D. PIVOT LIMIT _______ _f sets pivot limit 

for the problems (CC. 73-80). 

E. If the card is "CONTROLS," only, then the 
parameters are set to 0, 10, 1000, and 9999, 
respectively . 



2. TITLE, CARD: 



The second card in a problem deck must be a TITLE, card. 
The user may put anything desired in the remaining 74 columns. 
The title card is always printed on the output listing. The 
first six characters of the title supplied by the user will 
appear on all output and will serve as the identifying refer- 
ence in batched jobs. Error Message: If TITLE card is not 

encountered, problem terminates with ISTAT = 2. 
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3. ROW ID CARD: 



The third card in a problem must be a ROW ID card, fol- 
lowed immediately by the ROW Identification cards in the 
following format: 

Card Column 1-11: These columns must be blank. 



Card Column 12: This column is used to identify the 

type of constraint as follows: 



cc 


12 = + 


Implies 
form <_. 


that 


cc 


12 = - 


Implies 
form £. 


that 


cc 


12 = 


Implies 
form = . 


that 



the constraint is of the 
the constraint is of the 
the constraint is of the 



Card Columns 13-18: This field is used as the name of the 

row in six alphanumeric characters. 



Note: The first row is always the name of the objective 

function row; and for this row the only types allowed in 
card column 12 are + (minimize) or - (maximize) . 

Error Message: If ROW ID card is not found, problem 

terminates with ISTAT =3. If row name appears twice, problem 
terminates with ISTAT = 4. 



4. EOR CARD: 

The card terminating the definition of rows must be an 
EOR. Error Message: If an EOR is not found, problem ter- 
minates with ISTAT = 4. 



5. MATRIX CARD: 

The MATRIX card signals that the body of the matrix fol- 
lows. It is followed immediately by the matrix entry cards 
in the following format: 



CC. 


1-6 


Blank 


CC. 


7-12 


Column identification 






characters . 


CC. 


13-18 


Row identification of 



characters . 
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CC. 19-30 Value of matrix coefficient read in with 
F12.6 specification. 

Note: The first column read in must be the right-hand side 

of the problem. All other columns are read in from left to 
right across the matrix. In the columns the non-zero entries 
are read from the top down (see examples) . 

Error Message. If a MATRIX card is not found, problem ter- 
minates with ISTAT =5. If matrix entry is out of sequence, 
problem terminates with ISTAT = 6. 



6. EOR CARD: 

The card terminating the matrix entries must be an EOR. 
Error Messate: If an EOR not found, problem terminates with 

ISTAT = 6. 



7. BASIS CARD: 

The BASIS Card may appear after the matrix EOR and signals 
that some starting solution values are to be imposed on the 
solution. This card is followed immediately by the BASIS 
entry cards in the following format: 



CC. 


1-6 


Blank 


CC. 


7-12 


Six-character alphanumeric column name. 


CC. 


19-30 


Value of the variable read in with F12.6 
specification . 



If an imposed basis is used, the last BASIS entry card 
must be followed by an EOR card (see below) . 

WARNING : This option must be used with great care; for 

when a basis is proposed such as x^ = 5.0, this by implication 
adds to the original problem the constraint x. 5.0. Thus 
if the algorithm converges to an optimum solution, it is an 
optimum of the augmented (imposed basis) problem and not 
necessarily an optimum of the original. 



Error Message: If BASIS Card not found, no error message 

will appear; the program will assume that the card is an 
algorithm card and proceed accordingly. 



8 . EOR CARD : 

This card is necessary only if a preceding BASIS card 
is used. 
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Error Message: If EOR card not found, problem terminates 

with ISTAT = 8. 



9. ALGORITHM CARD: 

This card identifies the algorithm desired for application 
to the foregoing problem. The present algorithms in the 
ARRIBA system are as follows: 

CC. 1-4 IPSC - A Gomory cutting plane code with a row- 
ordering pivot choice rule. 

CC. 1-6 PRIMAL - A primal cutting plane code based on 

the algorithm of Harris. 

CC. 1-6BALASG - A version of the original Balas zero- 

one algorithm with the changes suggested 
by Glover. 



Error Messages: If an ALGORITHM card is not found, the 

program terminated the problem and prints "AGENDUM CARD RE- 
QUESTS INTEGER ALGORITHM NOT PRESENTLY IN ARRIBA." 

CC. 78-80 Upper bound on solution (IUPBND) used with IPSC 
and PRIMAL. 

As we define the matrix under consideration to be of the 
form: 



s . 



l 




a . . (-x . ) i = 2 
ID D 



/ 



M 



If the matrix is not lexicographically dual feasible 
(i.e., there exists at least one non-positive first non- 
zero column element) , ARRIBA transforms the matrix into 
usable form by defining the variable. 



Z = IUPBND + Z ( — x • ) 

D 

jes J 



where s is the set of negative columns and IUPBND is an upper 
bound on the sum of the variables in s. We now replace J 2 , 
the smallest column in s. by the substitution: 



x 



IPUBND + Z (-x . ) -Z. 

1 — 

]es J 



In this manner, the problem is brought into dual feasible 
form. 

It should be noted that IUPBND is selected as very large, 
the problem may run an excessive number of iterations. How- 
ever, if IUPBND is selected smaller than Z (-x.) at the 

jes 

optimal solution, the optimal solution will never be reached. 
Some analysis of the problem is, therefore, necessary to 
avoid either of the two situations above. 



10. ARRIBA CARD: 

This card signals the program to begin computation. 

Error Message: If an ARRIBA card is not found, the 

problem terminates with 'ISTAT = 12. 



11. EXIT CARD: 

This card signals the end of all jobs and exite the 
program. 

Error Message: If an EXIT card is not found, the problem 

terminates with ISTAT = 18. 



61 



COMPUTER OUTPUT 
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ALL PROBLEMS PROCESSED, HASTA LUEGO 



COMPUTER PROGRAM 



// EXEC PGM=ARRI BA,REGI0N=150K 

/ /ST E PL I 3 OD OISP=SHR, 0SM = F0 9 53-ARR I BA , VOL = SER = CEL 002 , UN I 

//FT06F 001 DO S Y SOUT = 0 , DC B = ( RECF M = F B A , BLKS I ZE= 33 25 , LR ECL = L 3 3 
//FT05F001 DO * 

CONTROLS, L I ST=108J VALUE EVERY 99 
ACTIVITY LIST EVERY 1000 PIVOT LIMIT 9999 
TITLE RESOURCE ALLOCATION FOR EXPERIMENTS 
ROW ID 

-ROW I 

+ R0W2 

+ R0W3 

+ R0W4 

+R0W5 

+ R0W6 

+ R0W7 

+ R0W8 

+ R0W9 

+ROW10 

+ ROWH 

+R0W12 

+R0WI3 

+R0W14 

+R0W15 

+ ROW 16 

+ROWI 7 

+R0W18 

+R0W19 

+ROW20 

+R0W2I 

+R0W22 

+R0W23 

+R0W24 

+ROW25 

+R0W26 

+ROW27 

+R0W28 

+R0W29 

+R0W30 

+R0W3I 

+R0W32 

EOR 

MATRIX 



COLO R0W2 
COLO R 0 W 3 
COLO R0W4 
COLO ROW 5 
COLO RUW6 
COLO ROW 7 
COLO ROWS 
COLO R0W9 
COLO ROWIO 
COLO ROW II 
COLO ROW 12 
COLO ROW I 3 
COLO R0W14 
COLO ROW I 5 
COLO ROW I 6 
COLO ROW! 7 
COLO R0W18 
COLO ROW l 9 
COLO R 0 W 2 0 
COLO R0W21 
COLO ROW22 
COLO RCW23 
COLO R0W24 
COLO ROW25 
COLO R0W26 
COLO ROW27 
COLO R0W23 
COLO RPW29 
COLO ROW30 
COLO R0W3I 



100. 000000 
110. 000000 
no. oooooo 
120.000000 
30. OOOOOO 

30. 000000 

32.000000 

35. 000000 

500. 000000 

500. 0000 00 

500. 000000 

500.000000 
1. OOOOOO 

1. 000000 

1. 000000 

1 . oooooo 

1 . 000000 

1. 000000 
1 . oooooo 

1.000000 

1. 000000 
1 . oooooo 

1.000000 

1 . 000000 
1 . oooooo 

1.000000 

1 . 000000 

1.000000 
l. oooooo 
1 . oooooo 
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COLO 


ROW32 


COL 1 


ROWl 


COL 1 


R r J W 2 


C0L1 


ROW 3 


COL 1 


ROW 6 


COL 1 


ROW 7 


C0L1 


ROW 10 


COL 1 


R0W1 1 


C0L1 


ROW 14 


COL 1 


R0W28 


C0L2 


R0W1 


COL 2 


ROW 1 


C0L2 


R0W3 


COL 2 


R0W4 


C0L2 


R0W7 


C0L2 


ROWS 


C0L2 


ROW 1 1 


C0L2 


R0W12 


COL 2 


RO W l 5 


C0L2 


R0W23 


C0L3 


ROWl 


C0L3 


ROWL 


C0L3 


R0W4 


COL 3 


ROW 5 


C0L3 


ROW 8 


C0L3 


R0W9 


COL 3 


ROW 12 


C0L3 


ROWl 3 


COL 3 


R0K16 


C0L3 


R0W2 8 


C0L4 


ROWl 


COL 4 


R 0 W 3 


C0L4 


R 0 W 4 


C0L4 


RO W5 


C0L4 


ROW 7 


C0L4 


ROW 3 


C0L4 


R0W9 


C0L4 


ROWl l 


C0L4 


ROW 12 


C0L4 


ROW 13 


COL 4 


ROW 17 


C0L4 


ROK'2 9 


COL 5 


ROWL 


C0L5 


R0W2 


C0L5 


R0W3 


C0L5 


R0W4 


C0L5 


ROWS 


COL 5 


ROW 7 


C0L5 


ROWS 


COL 5 


ROW l 0 


COL 5 


ROWL 1 


C0L5 


ROWl 2 


COL 5 


R0W13 


C0L5 


ROW 2 9 


C0L6 


ROWl 


COL 6 


R 0 W 3 


COL 6 


R0W4 


C0L6 


ROW 5 


COLS 


ROW 7 


C0L6 


ROWS 


C0L6 


ROW 9 


C0L6 


ROWL 1 


COL 6 


ROW 12 


COLS 


ROW 13 


COLS 


R0W19 


COLS 


PQwiO 


C0L7 


ROWl 


COL 7 


RO.vZ 


COL/ 


ROW 3 


C0L7 


R0W4 


COL 7 


ROWS 


C0L7 


R0W7 



1.000000 

163. 000300 

30 . 000000 

30.000000 
5. 000000 
5. 000000 
200. 030003 

200. 000000 

1.000000 

1. 0000 30 

168. 000000 

252 .000000 

30. 000000 

30. 000000 

5.000000 

5. 0CC000 

200.000000 

200. 000030 

1. 000000 

1.000000 

168. 0 30000 

252. 000000 

30.000000 

30. 000000 

5.000000 
5. 0300 00 
200 . 000000 

200. 000000 

1. 0 30000 

1. 000000 

432.000333 
50. 000000 

50.000000 
50. 033333 

5. 000000 

5.000000 

5. 3 33000 

200. OOOOOO 
200.0003 30 

200. 000000 

1 .000000 

1. 000000 

432. 000000 

50.000000 
50. 030000 
50. 0000 JO 

5.0000 30 
5. OOOOOO 

5.000000 

200. 000000 
2 00. 0000.30 
2C0. OOOOOO 

1. OOOOOO 
1. OOOOOO 

1 76.000 030 
40. 003000 
4 3. 0 333 33 

40. 000000 
20.0003 33 
20. 003000 

20 . 000000 
133. 303333 
ICC. OOOOOO 

100. 000000 
1. 003000 
1. OOOOOO 

176.000030 
4 0. OOOOOO 

40.000000 

40.000030 

20. 000000 

20.000000 
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EHR 
I PSC 
ARRI6A 

EXIT 



C0L7 


R0W8 


20. 000000 


COL 7 


ROW 10 


100. 000000 


COL7 


ROW 11 


100.000000 


COL 7 


R0W12 


100. 000000 


COL 7 


R0W20 


1 . 000000 


COL7 


R0W30 


1 . oooooo 


COL 8 


ROW 1 


104. OOOOOO 


COLB 


R0W2 


30.000000 


COLB 


R0W3 


30. OOOOOO 


COL 8 


ROW 6 


15. OOOOOO 


COLB 


ROW 7 


15.000000 


COL 8 


R 0 W 1 0 


80. OOOOOO 


COL8 


R0W1 1 


80. OOOOOO 


COL8 


R0W21 


l. OOOOOO 


COL 8 


R0W31 


1. OOOOOO 


COL9 


ROW l 


104.000000 


COL 9 


ROW 3 


3 0. OOOO OO 


COL 9 


R0W4 


30. OOOOOO 


COL9 


P0W7 


15.000000 


COL 9 


ROWS 


1 5. OOOOOO 


COL9 


ROW 11 


80. OOOOOO 


COL9 


ROW 12 


80.000000 


C0L9 


R0W22 


1. OOOOOO 


C0L9 


ROW 3 l 


1.000000 


COIO 


ROWl 


1 04.000000 


coio 


RCW4 


30. 300000 


C010 


R0W5 ‘ 


30.000000 


COIO 


ROW 3 


15. OOOOOO 


COIO 


ROW 9 


15. OOOOOO 


COIO 


ROW 12 


83.000033 


COIO 


ROWl 3 


80. OOOOOO 


COIO 


ROW23 


1 . OOOOOO 


COIO 


RO W3 1 


1 . OOOOOO 


con 


ROWl 


120. OOOOOO 


con 


R0W2 


20.000000 


coil 


R0W6 


1 0. 0 00 3 00 


COI 1 


ROW 10 


50. OOOOOO 


con 


ROW 2 4 


l.OCCOOO 


coil 


ROM 3 2 


1. oooooo 


CO 12 


ROWl 


120. OOOOOO 


con 


R0W3 


20. OOOOOO 


C012 


ROW 7 


1 0. OOOOOO 


con 


ROWl 1 


50. OOOOOO 


C012 


ROW25 


1. 0 000 30 


CO 12 


ROW 3 2 


1. OOOOOO 


C013 


ROWl 


120.000000 


CO 13 


ROW 4 


2 0. OOOOOO 


C013 


ROWS 


10.000000 


C013 


ROW 12 


50. 0 000 00 


CO 1 3 


RCW26 


1. oooooo 


COI 3 


R0W32 


l. oooooo 


con 


ROWl 


120. OOOOOO 


COI 4 


R0W5 


20. OOOOOO 


con 


R0W9 


10.000000 


con 


ROW 13 


50. OOOOOO 


CO 14 


ROW 2 7 


1.000000 


C 014 


R0W32 


1.000000 
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